New methods for studying visual communication and multimodal integration
نویسندگان
چکیده
منابع مشابه
Audio-visual Integration in Multimodal Communication
In this paper, we review recent research that examines audio-visual integration in multimodal communication. The topics include bimodality in human speech, human and automated lip-reading, facial animation, lip synchronization, joint audio-video coding, and bimodal speaker verification. We also study the enabling technologies for these research topics, including automatic facial feature trackin...
متن کاملMultimodal visual-somatosensory integration in saccade generation.
Neurophysiological studies have demonstrated multisensory interaction effects in the neural structures involved in saccade generation when visual, auditory or somatosensory stimuli are presented bimodally. Visual-auditory interaction effects have been demonstrated in numerous behavioural studies of saccades but little is known about interaction effects involving somatosensory stimuli. The prese...
متن کاملFinite-state Methods for Multimodal Parsing and Integration
Finite-state machines have been extensively applied to many aspects of language processing including, speech recognition (Pereira and Riley, 1997; Riccardi et al., 1996), phonology (Kaplan and Kay, 1994; Kartunnen, 1991), morphology (Koskenniemi, 1984), chunking (Abney, 1991; Joshi and Hopely, 1997; Bangalore, 1997), parsing (Roche, 1999), and machine translation (Bangalore and Riccardi, 2000)....
متن کاملon the comparison of keyword and semantic-context methods of learning new vocabulary meaning
the rationale behind the present study is that particular learning strategies produce more effective results when applied together. the present study tried to investigate the efficiency of the semantic-context strategy alone with a technique called, keyword method. to clarify the point, the current study seeked to find answer to the following question: are the keyword and semantic-context metho...
15 صفحه اولThe integration of emotional and symbolic components in multimodal communication
Human multimodal communication can be said to serve two main purposes: information transfer and social influence. In this paper, I argue that different components of multimodal signals play different roles in the processes of information transfer and social influence. Although the symbolic components of communication (e.g., verbal and denotative signals) are well suited to transfer conceptual i...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Visual Communication
سال: 2012
ISSN: 1470-3572,1741-3214
DOI: 10.1177/1470412912446558